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ABSTRACT 



A feedback-based adaptive network is described wherein at 
least a portion of the network elements report operating 
information relating to network conditions to a centralized 
data store. The information which is reported to the data 
store is analyzed by a policy engine which includes a 
plurality of application specific plug-in policies for analyz- 
ing selected information from the data store and for com- 
puting updated control information based upon the analysis 
of the information. The updated control information is fed 
back to selected network elements to thereby affect opera- 
tion of the selected elements. Typically, when the operation 
of a network element has been affected, its corresponding 
operating information will change. The new or changed 
network element operating information is then reported to 
the data store and analyzed by the policy engine. The policy 
engine may then generate new or updated control informa- 
tion for affecting the operation of selected elements in the 
network. In this way, the dynamic and automatic feedback 
control of network elements is provided in order to allow the 
rework to adapt to changing conditions. Events relating to 
changing conditions in the network may be reported to 
selected elements in the network using an event notification 
service. Additionally the adaptive, feedback-based network 
of the present invention may include a network quality 
monitoring system for evaluating performance characteris- 
tics or other aspects of the network based upon predeter- 
mined standards or criteria. If it is determined that a par- 
ticular characteristic of the network does not conform with 
the standards established for that characteristic, the policy 
which controls that particular characteristic of the network 
may be automatically and dynamically modified to thereby 
affect the network performance. 

29 Claims, 20 Drawing Sheets 
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DYNAMICALLY ADAPTIVE NETWORK 
ELEMENT IN A FEEDBACK-BASED DATA 
NETWORK 

RELATED APPLICATION DATA 

This invention is related to U.S. patent application Ser. 
No. 09/342,337, filed on the same day as this patent 
application, naming Shankar Natarajan, Andrew G. Harvey, 
Hsuan-Chung Lee, Vipin Rawat, and Leo Pereira as 
inventors, and entitled "Policy Engine which Supports 
Application Specific Plug-ins for Enforcing Policies in a 
Feedback-Based, Adaptive Data Network". That application 
is incorporated herein by reference in its entirety and for all 
purposes. 

This invention is related to U.S. patent application Ser. 
No. 09/342321, filed on the same day as this patent 
application, naming Shankar Natarajan, Andrew G. Harvey, 
Hsuan-Chung Lee, Vipin Rawat, and Leo Pereira as 
inventors, and entitled "Dynamic Adjustment Of Network 
Elements Using A Feedback- Based Adaptive Technique". 
That application is incorporated herein by reference in its 
entirety and for all purposes. 

This invention is related to U.S. patent application Ser. 
No. 09/342,742, filed on the same day as this patent 
application, naming Shankar Nataraj an, Andrew G. Harvey, 
Hsuan-Chung Lee, Vipin Rawat, and Leo Pereira as 
inventors, and entitled "Technique for Collecting Operating 
information from Network Elements, and for Controlling 
Network Element Behavior in a Feedback-Based, Adaptive 
Data Network". That application is incorporated herein by 
reference in its entirety and for all purposes. 

This invention is related to U.S. patent application Ser. 
No. 09/342,341, filed on the same day as this patent 
application, naming Shankar Natarajan, Andrew G. Harvey, 
Hsuan-Chung Lee, Vipin Rawat, and Leo Pereira as inven- 
tors and entitled "Technique for Providing Dynamic Modi- 
fication of Application Specific Policies in a Feedback- 
Based, Adaptive Data Network". That application is 
incorporated herein by reference in its entirety and for all 
purposes. 

This invention is related to U.S. patent application Ser. 
No. 09/342,714, filed on the same day as this patent 
application, naming Shankar Natarajan, Andrew G. Harvey, 
Hsuan-Chung Lee, Vipin Rawat, and Leo Pereira as 
inventors, and entitled "Technique for Providing Automatic 
Event Notification of Changing Network Conditions to 
Network Elements in an Adaptive, Feedback-Eased Data 
Network". That application is incorporated herein by refer- 
ence in its entirety and for all purposes 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates generally to data networks, 
and more specifically to a technique for providing a 
feedback-based data network for dynamically adapting to 
changing network conditions. 

2. Background 

The merging of computers and communications has had 
a profound influence on the way computer systems are 
organized. As computer technology advances, the role of 
computer networks steadily increases. Various types of 
computer networks include internetworks (e.g., the 
Internet), local area networks (LANs), metropolitan area 
networks (MANs), and wide area networks (WANs). 

The use of networks such as LANs or WANs allows data 
or other information to be exchanged over large distances at 
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a reasonable speed, and at relatively low cost. Although 
conventional network systems are advantageous for a vari- 
ety of reasons, implementing and maintaining such networks 
presents an ongoing problem. Moreover, a network may 

5 span a plurality of separate LANs and/or WANs to create the 
impression of a unified network- This has greatly compli- 
cated the implementation, maintenance, and control of sys- 
tem parameters within the network. 
As the use of computer networks proliferates, there exists 

10 an increasing need to improve computer network designs 
and implementations in order to facilitate the management, 
implementation, and modification of such networks. 

SUMMARY OF THE INVENTION 

15 According to specific embodiments of the invention, a 
technique is provided for implementing a feedback-based 
data network which is able to automatically and dynamically 
monitor characteristics of various aspects of the network and 
adapt to changing network conditions by dynamically and 
automatically modifying selected network parameters in 
order to achieve a desired performance level. 

According to a specific embodiments of the invention, a 
method and computer program product are disclosed for 

25 providing dynamic configuration of network elements in a 
data network. The data network includes at least one net- 
work element having a plurality of operating parameters 
associated therewith. The operating parameters associated 
with a selected network element are related to at least one 

30 control parameter of that element. Operating parameter 
information relating to at least one network element is 
reported to a data store within the network. The network 
element may then receive notification of an event relating to 
a change in network conditions. In a specific embodiment, 

3 5 this change in network conditions is related to at least one 
control parameter associated with the network element. 
Updated information relating to the at least one control 
parameter is then retrieved, and used to dynamically con- 
figure the network element to thereby affect operation of the 

40 network element. Where the event relates to changing con- 
ditions in the network, the network element may be auto- 
matically and dynamically configured to adapt to the chang- 
ing network conditions using the updated information. 
An alternative embodiments of the present invention 

45 disclose a method and computer program product for pro- 
viding dynamic feedback control of network elements in a 
data network. The data network includes at least one net- 
work element having a plurality of operating parameters 
associated therewith. The operating parameters associated 

50 with a selected network element are related to at least one 
control parameter of that element. Operating parameter 
information relating to a first portion of network elements is 
provided to a data store. Updated control information is then 
received by at least one network element. The updated 

55 control information may be generated in response to the 
information reported to the data store, and may be used for 
affecting operation of the network element. The network 
element is then automatically configured using the updated 
control information to thereby affect its operation. 

60 An additional embodiment of the present invention pro- 
vides a dynamically configurable data network comprising 
at least one network element having a plurality of operating 
parameters associated therewith. The operating parameters 
associated with a selected network element are related to at 

65 least one control parameter of that element. The network 
element is operable to report at least a portion of its 
operating parameter information to a data store. The network 
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element is further operable to retrieve updated information 
relating to at least one control parameter of the element in 
response to receiving notification of an event relating to 
changing conditions in the network. The element is further 
operable to automatically configure itself using the retrieved 
updated information to thereby affect at least one of its 
operating parameters. Moreover, the updated information 
may be used to cause the network element to automatically 
and dynamically adapt to the changing network conditions. 

A further embodiment of the present invention is directed 
to a dynamically configurable network element in a 
feedback-based adaptive network. The element comprises at 
least one CPU, memory, a data structure for storing control 
information used for configuring the network element, and 
an event handling entity operable to receive event notifica- 
tion information. The event handling entity is further oper- 
able to report errors detected by the network element to an 
event notification server. 

Additional features and advantages of the present inven- 
tion will become apparent from the following descriptions of 
its preferred embodiments, which descriptions should be 
taken in conjunction with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 shows an example of a schematic block diagram of 
a conventional frame relay network 150. 

FIG. 2 shows a schematic block diagram of a specific 
embodiment of the feedback-based, adaptive data network 
of the present invention. 

FIG. 3 shows a schematic block diagram of the adaptive 
feedback-based data network of FIG. 2, implemented as a 
frame relay network. 

FIG. 4 shows a schematic block diagram of an alternate 
embodiment of the feedback-based, adaptive data network 
of the present invention. 

FIG. 5A shows a schematic block diagram of a router 10 
which may be implemented as a network element in accor- 
dance with the feedback-based, adaptive data network of the 
present invention. 

FIG. 5B shows a schematic block diagram of data store 
252 of FIG. 2, in accordance with a specific embodiment of 
the present invention. 

FIG. 5C shows a schematic block diagram of policy 
engine 254 of FIG. 2, in accordance with a specific embodi- 
ment of the present invention. 

FIG. 6 shows an example of a flow diagram of an 
initialization procedure for initializing the network of FIG. 
2. 

FIG. 7 shows a flow diagram of an event registration 
procedure 700 in accordance with a specific embodiment of 
the present invention. 

FIG. 8 shows a flow diagram of a network element 
reporting procedure 800 in accordance with a specific 
embodiment of the present invention. 

FIG. 9A shows a flow diagram of an event notification 
procedure 900A in accordance with a specific embodiment 
of the present invention. 

FIG. 9B shows a flow diagram of an event notification 
response procedure 900B in accordance with a specific 
embodiment of the present invention. 

FIG. 10 shows a flow diagram of a network element 
parameter update procedure 1000 in accordance with a 
specific embodiment of the present invention. 

FIG. 11 shows a specific embodiment of a flow diagram 
of a policy engine analysis procedure 1100, which may be 
implemented by the policy engine 254 of FIG. 2. 
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FIG. 12 shows a flow diagram example of a frame relay 
QR policy 1200 which may be implemented by procedure 
1100 of FIG. 11. 

FIG. 13 shows a specific embodiment of a flow diagram 
5 for implementing a network performance quality monitor 
procedure 1300, which may be implemented by monitor 
system 262 of FIG. 2. 

FIG. 14 shows a specific embodiment of a flow diagram 
for implementing an administration procedure 1400, which 
10 may be implemented by ADMIN system 260 of FIG. 2. 

FIG. 15 shows an example of a flow diagram for imple- 
menting a data store event handler reporting procedure 
1500, which may be implemented by data store 252 of FIG. 

is 2 - 

FIGS. 16, 17 and 18 illustrate schematic diagrams and 
flow diagrams, showing, by way of example, how the 
feedback-based adaptive network of the present invention 
may be implemented in a network for automatically adapt- 
20 ing to changes in network conditions. 

DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENTS 

FIG. 1 shows an example of a frame relay network. The 

25 frame relay network may be thought of as comprising a 
group of frame relay virtual circuits for transmitting data 
between a first user/computer system and a second user/ 
computer system. A frame relay virtual circuit represents a 
high-speed packet switching path used in wide area net- 

30 works. It has become very popular for LAN to LAN 
connections across remote distances. A consumer may lease 
a frame relay virtual circuit between two points and send 
packets of information between the two points. It is also 
possible to lease frame relay circuits between a given site 

35 and multiple other sites. 

As shown in FIG. 1, a frame relay network with one frame 
relay virtual circuit 150 connects a client computer 102 with 
a server 114. Typically a service provider charges for access 
at both ends of the network. When leasing the frame relay 

4 virtual circuit, the consumer agrees to pay a specified 
amount of money in return for the service provider guaran- 
teeing a time-averaged bandwidth for the virtual circuit. 
One difference between a physical leased line and a frame 

45 relay circuit is that, with the physical leased line, a user pays 
for a specified amount of bandwidth, and may send traffic all 
day long at the maximum speed. However, with a virtual 
circuit, data bursts may be sent it full speed, but the 
long-term average usage (i.e., committed information rate or 

50 CIR) must be at or above a predetermined level. 

Typically, when a client is provisioned a virtual circuit, a 
service provider will guarantee to provide a minimum 
amount of bandwidth for handling client traffic. More 
specifically, the consumer pays for, and the service provider 

55 agrees to provide, a virtual circuit which is able to handle a 
specified committed burst size (Be) of data (e.g. Bc~256K 
bits) over a specified committed time interval (Tc) (e.g. Tc=l 
second). The value Bc/Tc is referred to as the committed 
information rate (CIR), which specifies the rate at which the 

60 virtual circuit will accept data from the consumer. In the 
example above, the CIR value is equal to 256K bits/sec, 
meaning that over the span of one second, the service 
provider guarantees to handle 256Kbits of data. 

At times, however, a client may be running an application 

65 which requires more than 256K bits/sec of bandwidth. For 
example, the client may be required to send bursts of traffic 
at 300K bits/sec from time to time. Although the CIR value 
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represents the average guaranteed bandwidth for the virtual 
circuit, the service provider also provides an allowance for 
data bursts. This allowance is referred to as the excess burst 
size (Be) (e.g. Be=64Kbits). Thus, using the example above, 
in time Tc (1 second), the B(value (256K) may be exceeded $ 
by Be (64K) without the customer having to pay. This 
amount of additional bandwidth is referred to as the excess 
information rate (ElR=Be/Tc), and represents the excess 
bandwidth which the service provider will attempt to deliver 
to the consumer. Any data sent by the consumer in excess of Q 
the EIR value will be dropped. Further, data bursts which are 
between the Be and Be value may be discarded in the event 
of network congestion. 

The frame relay virtual circuit 150 of FIG. 1 comprises a 
plurality of individual network elements (e.g., 104A, 104B, 35 
108) which are part of a wide area network. Typically, 
different portions of the wide area network are owned and/or 
managed by separate entities. For example, the service 
provider may manage or control the gateways (104A, 104B) 
for accessing the wide area network from either the client 2 q 
machine 102 or server machine 114. More typically, 
however, the gateways are controlled by the end user who 
has the ability to reconfigure these devices. Gateway devices 
104A and 104B may, in turn, communicate with frame relay 
cloud 110, which may be managed or controlled by a ^ 
separate entity such as, for example, a data network com- 
pany (e.g., AT&T, MCI, Sprint, etc.). Typically, the frame 
relay service provider and the frame relay carrier are the 
same entity. 

In the example of FIG. 1, devices 104A and 104B 30 
represent frame relay devices, such as, for example, routers 
which are configured to handle frame relay protocol. Each of 
the frame relay devices 104A, 104B arc typically statically 
configured by a system administrator using a command line 
interface (CLI) via a local console (106A, 106B, 35 
respectively). Each terminal 106A, 106B is connected 
directly to its respective Frame relay device via a local 
console port (not shown) at the device. The virtual circuit 
between frame relay device 104A and frame relay device 
104B is provided by the FR cloud network 110, maintained 40 
and controlled by the frame relay service provider. The FR 
cloud includes a plurality of switching devices (108) which 
are statically configured by a system administrator to pro- 
vide virtual circuits, each circuit having a specified CIR and 
EIR value. When a service provider provisions a virtual 45 
circuit having specific CIR and EIR values, a human tech- 
nician is hired to provision the circuit by statically config- 
uring specific network elements within the cloud to form the 
desired communication path having the specified CIR and 
EIR values. 50 

Conventionally, the provisioning of a virtual circuit by a 
service provider requires not only manual configuration of 
frame relay devices 104A, 104B, but also requires coordi- 
nation between the end user and the service provider which 
manages the FR cloud 110. This coordination usually takes 55 
place by sending a request to the service provider to imple- 
ment or modify a virtual circuit within FR cloud 110. Once 
the request is received by the service provider, it is handled 
manually by a service technician who statically configures 
the various switches and other devices within the FR cloud 60 
110 to implement a virtual circuit having specified CIR and 
EIR values. Because of the manual steps involved, it is not 
uncommon for days to pass before the consumer (e.g., client 
102) is able to use the virtual circuit. 

Moreover, significant delays may be experienced when 65 
attempting to modify or reconfigure parameters associated 
with a virtual circuit. For example, let us suppose that the 
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consumer initiates a video conferencing application between 
client 102 and server 114. Further, let us suppose that the 
current CIR and EIR bandwidth values for virtual circuit 150 
are insufficient for supporting high quality video/voice 
applications, resulting in the client 102 receiving poor 
quality video images and voice information from server 114. 
In order to overcome this problem, a human operator at the 
client side may send a request to the service provider to 
increase the CIR value for the virtual circuit 150. 

However, in order to increase the CIR and/or EIR values 
on the virtual circuit 150, a plurality of network elements 
within the WAN which form the communication path 
between client machine 102 and server 114 must be stati- 
cally reconfigured by a human operator to support the new 
CIR and EIR values. Thus, when the request from the human 
operator a client side is received at the service provider end, 
a system administrator or other service technician must 
statically reconfigure each of the network elements which 
form the virtual circuit connecting client 102 with server 
114. This may include statically reconfiguring frame relay 
devices 104A and 104B (via local console/terminals 106A, 
106B, respectively), and also may include reconfiguring the 
appropriate switches 108 and/or other devices which are part 
of FR cloud. This manually implemented, time consuming 
procedure is extremely undesirable. 

Additionally, it should be noted that parameters in con- 
ventional frame relay network devices are typically derived 
from a static on-board configuration having minimal inter- 
action with the provisioning switching device in the network 
and no interaction with the far end device that terminates the 
circuit. The presence of various network elements in the 
network implies that no network element is an isolated 
entity, but rather is affected by other network elements that 
surround it. Accordingly, control actions performed on one 
network element can affect other network elements. Since 
the performance of the "switching fabric" can affect the 
performance of the "edge devices", it is preferable to pro- 
vide a network model which is able to accommodate the 
"multi-variable" nature of networks and implement a control 
scheme wherein information from at least a portion of 
related network elements is collected before a management 
or control decision is made at a particular network element. 

Using the technique of the present invention, a dynamic 
feedback-based adaptive network may be provided for auto- 
matically detecting a client's need for increased bandwidth, 
and for automatically and dynamically reconfiguring the 
appropriate network elements to provide sufficient band- 
width on the virtual circuit to support the user's current 
applications). The feedback-based adaptive network of the 
present invention monitors current conditions of local and/or 
remote network elements and dynamically adjusts network 
control parameters based upon analysis of the monitored 
network elements. A specific embodiment of the dynami- 
cally configurable feedback-based adaptive network of the 
present invention is shown in FIG. 2 of the drawings. 

The feedback-based adaptive network of the present 
invention utilizes a technique wherein at least a portion of 
the network elements (e.g., 204A, 204B, 208A, 208B, etc.) 
report network information relating to network conditions to 
a centralized data storage entity (e.g., data store 252). The 
reported data corresponds to information relating to the 
current condition or status of each of the reporting network 
elements in the network. The information which is reported 
to the data store 252 is analyzed by a policy engine 254. The 
policy engine 254 includes a plurality of application specific 
plug-in policies for analyzing application specific informa- 
tion from the data store and for computing updated control 
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information based upon the analysis of the information. The based adaptive configuration technique of the present inven- 

updated control information may include any type of tion will include a monitor/agent (not shown) for 

information, parameter, and/or actions which may be used to monitoring, measuring and/or computing information (e.g. 

affect the operation of one or more network elements. The state data) and for reporting this information to the data store 

updated control information is then fed back to selected 5 252. The monitor/agent may be implemented via hardware, 

network elements to thereby affect operation of the selected software, or a hybrid combination of hardware and software, 

elements and/or network. Typically, when the operation of a J|? e reported information may be used by the policy ^engine 

network element has been affected, its corresponding oper- 254 to calculate updated control information for effecting 

ating parameters and/or operating information will change. me operation of the network element 204A. As described in 

The changed operating parameters are then reported to the 10 ° w , there are a number of ways in which the 

data store 252 and analyzed by the policy engine 254. Hie <? ntrol "*>nnauon ma V be fed J>«* 1Dt0 the 

policy engine may then generate new or updated control network element. Once received the network element wil 

information or parameters for affecting the operation of amomaUcally "iflgute itself utilizing the updated control 

selected elements in the network. In this way, the network of ^«mation to thereby affect its operation, which may 

FIG. 2 is configured to adapt to changing conditions in the is ^^hide affecting one or more operational parameters of the 

network by providing a dynamic feedback mechanism. network elements. 

Using this dynamic feedback mechanism, selected network ln a specific embodiment where the network element is 

elements may be dynamically and automatically reconfig- P** of a frame rela X circuit > examples of the information 

ured to cause the performance of various aspects of the reported by the network element may include information 

network to conform with desired performance criteria. 20 relatin S to: committed information rate (CIR), excess infor- 

- j, . , - , 4 . - . . , mation rate (EIR), committed burst size (Be), excess burst 

The feedback-based adaptive network of FIG. 2 includes . ^ ^ v . . , '\ A 

i v* r *, ii* iaja moA iaod *h\at> size (Be), congestion indicators (e.g., discarded eligibility 

a plurality of network elements 204A, 208A, 208B, 204B, u » \ u c i . a a/ a - ■ »• 

Z- , ' , . 4 . i_ 7 ™~ bits), number or packets dropped (e.g. durmg a given time 

which are part of the communication path between user 202 . . ' .* f . i * j • *l. 

j <£^| a y ■ , t r T-Ti- i l. c lL interval), queue length at selected circuits within the net- 

and user 214. In the embodiment of FIG, 2, each of the i r . . r<. -u c *u u a ™-u a 

a _ . , - nMn r , -< work element, etc. Further, any of the above described 

network elements 204A and 204B may be, for example, a 25 » , > ' 

... . , v. * 4 t_ • parameters may be dynamically and automatically modined 

server or a router which communicate with each other via a r j.ju .l r • a e a^ \ \ a - a 

wide area network (WAN) 210. The WAN may include a ° r »P d f ? b V * e f ^ «B«* and ba <* <° desired 

plurality of network elements (NE) 208A, 208B, which may ™ ^ for • ffcctn « ** °P eraUon 0r P«fo™»« 

include switches and/or other network elements for provid- , , „ ^ _ 

• t - ,. i, L att ™^ a i „ af , nft/(A ««j-iajo in According to the embodiment of FIG. 2, each network 

ing a communication link between element 204A and 204B. JU , , ? . , . - . 

.„ . . , . • element which reports its respective operating information 

It will be appreciated, however, that the dynamic to dala st0fe 2$2> such for e le network element 

feedback-based adaptive network technique of the present 2 ^ K indudes a ^ cachc 2?6A and m cvcnt handkr 

invention may be implemented m any conventional data (£H) 2?4A for handlin evem no tm cat i on / reg istration. 

network for providing adaptive and automatic feedback Cache 2?6A re nte ty of mcmorv dcvicc which 

control of network elements within that network. Thus, for be Ufied fof ^ cachj dated control 

example, the technique of the present invention may be information received at the network element. In a specific 

implemented in conventional LANs, WANs, MANs embodim ent, this memory device may be a persistent store, 

internetwork*, general purpose networks, packet switched ^ the dated mntJQl mformation has becn cached mt0 

networks, circuit switched networks, etc. Moreover, the i oca i cache 276A, the network element retrieves the updated 

technique of the present invention may be applied to any contro , information from me cache re-configures itself 

conventional data network. using ^ up(Jated contfol information . AdditionaUy, as 

As used in this application, the term "control element" shown in FIG. 2, network elements 208A and 208B may also 

refers to the additional hardware and/or software control include respective local caches (C) 276A, 276B for storing 

components for implementing dynamic feedback control of 45 updated control information, and may also include respec- 

a conventional network. For example, in the embodiment of Uvc evcnt handling entities (EH) for receiving/reporting 

FIG. 2, the control elements include data store 252, monitor even notification information. 

system 262, ADMIN system 260, policy engine 254, and Although many of the various features of the present 

event server 270. Additionally, as used in this application, invention are described with respect to the network element 

the term "network element" refers to any hardware or 5Q 204Aof FIG. 2, it will be appreciated that the descriptions 

software component of the adaptive feedback-based net- of me var i 0 us techniques of the present invention are 

work of the present invention, including control elements. applicable to any network element in the network. However, 

The network element may be a logical or physical entity for purposes of simplification, network element 204A is 

within the network which is being managed or controlled. used in this application to exemplify many of the techniques 

The network element is preferably designed with built-in 55 provided by the present invention, 

instrumentation which allows for the collection of relevant One advantage of providing a local cache 276A for 

information which may be subsequently used to determine storing updated control information is that this data will be 

control actions to be applied to the network element. In the available for use by the network element even during times 

network of FIG. 2, network element 204A may be any when the communication link between the network element 

hardware or software component which has a measurable 60 ^d other parts of the network (e.g., data store 252, event 

parameter that can be reported. Examples of network ele- server 270, policy engine 254, etc.) have been interrupted, 

ments include routers, switches, hosts, modems, terminals, j\ XUSf f or example, when the network element is unable to 

dial access servers, gateways, ports, channels, interfaces, access information from the data store or other network 

circuits, processes, drivers, protocols, services, applications, elements, the local cache 276A may be accessed in place of 

ctc - 65 data store 252. In specific embodiments where the protocol 

In accordance with a specific embodiment, a network for accessing data within data store 252 differs from the 

element which has been configured to support the feedback- protocol for accessing data within data cache 276A, a 
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translation mechanism may be provided. For example, server in order to receive notification for specified events, 

where the data store is implemented as an LDAP server, and such as, for example, the availability of updated control 

the local cache is implemented as a file system, a translation information at data store 252. In a specific embodiment, 

mechanism will be provided at the network element for event handler 274 A may consult a configuration file 

converting LDAP calls into file system calls and vice versa. 5 (residing at element 204A) in order to determine which 

In a specific embodiment, all current control parameters events to register with at event server 270. This feature is 

used by a particular network element (e.g. network element described in greater detail in a latter section of this appli- 

204A) are maintained within its local cache 276A The cation relating to FIG. 7 of the drawings, 

network clement configures itself using the control infor- Another purpose of event handler 274A is to provide the 

mation contained within the local cache 276A Periodically, 10 ability for the network element to receive event notification 

when the control information for that network element is messages from event server 270. Thus, once the event 

updated (by policy engine 254, for example), the updated handler has registered for event notification with event 

control information is then stored within cache 276 A. server 270, the event handler is then able to receive event 

Thereafter, the network element may reconfigure itself using notification messages from event server 270, and take appro - 

the updated control information stored within cache 276A 15 priate action. This feature is described in greater detail in a 

This feature is described in greater detail in a latter section latter section of this application relating to FIGS. 9 A and 9B 

of this application relating to FIGS. 9B and 10 of the of the drawings. 

drawings. In at least one embodiment, the cache is implc- y e t another purpose of the event handler is to monitor 

mented using non-volatile memory so that the updated specified network elements, and report the detection of 

control information may be saved in the event of a power 20 specified events (e.g. detected errors) to event server 270. In 

failure of the network element. a specific embodiment, the event handler may consult a local 

One advantage of caching the updated control information configuration file to determine the particular type of events 

within cache 276A is that the updated control information it is to be monitoring at a specified network element. In an 

may be immediately stored within cache 276A even during alternate embodiment, the event handler is statically pre- 

times when the network element itself is busy and unable to 25 configured so that when it is initialized, it automatically 

immediately reconfigure itself using the updated control monitors a specified network element for specific types of 

information. In this way, the device which handles the data events and reports detected events to event server 270. For 

transfer and caching operation is able to complete its task example, when an error is detected by network element 

without having to wait for the network element to be 204A, the event handler 274A will report the error to event 

available for re-configuration before caching the updated 30 server 270 to be forwarded to other network and/or control 

information. elements (e.g. policy engine 254), which may be interested 

In an alternate embodiment, the current control param- in this type of information. This feature is described in 

eters used by the network element are maintained in a main greater detail in a latter section of this application relating to 

memory of the network element (not shown). In this 35 FIG. 9B of the drawings. 

embodiment, cache 276A functions primarily as a back-up Although a detailed explanation of the event notification 

in case of a connection failure with other parts of the service is provided in latter sections of this application, a 

network. The updated control information are pushed brief example will now be provided using the network of 

directly into the main memory of the network element and FIG. 2. 

the control action is immediately implemented. ^ In this example, it will be assumed that network element 

Additionally, the updated control information is stored 204A uses event handler 274A to register for event notifi- 

within cache 27 6A, which acts as a default/back-up mecha- cat j 0D service with event server 270. When the policy engine 

nism. When a communication failure occurs and the network 2 54 calculates updated control information for network 

element is unable to access the updated control information element 204A, it stores the updated control information in 

from the data store, event server, and/or policy engine, the 45 ^ata store 252. Event handler 272 continually monitors the 

network element resorts to retrieving control parameters <jata store for updated control information and other events, 

from the cache 276 A. j n an alternate embodiment (not shown) the event handler 

As shown in FIG. 2, network element 204A includes an 272 may physically reside at a device other than data store 

event handler 274A. In a specific embodiment, each network 252. When the event handler 272 detects newly updated 

element which receives its control information from the data 50 control information within the data store relating to network 

store includes an associated event notification agent. element 204A, it notifies event server 270 which, in turn, 

In a specific embodiment, the event notification service is notifies network element 204A of the updated control infor- 

implemented using a standardized common object request mation. In one embodiment, the actual control information 

broker architecture (CORBA) event service API, commonly is passed to the network element and cached within local 

known to those skilled in the art. However, although the 55 cache 276A. In an alternate embodiment, notification relat- 

standardized CORBA event service API is generally known ing to the availability of updated control information is 

to those having ordinary skill in the relevant art, the use of passed to the network element (via event handler 274A). The 

a CORBA event service as a notification mechanism to network element then responds to this notification by 

notify data network elements of changed network conditions retrieving the appropriate updated control information from 

and/or parameters is believed to be a novel concept. In an $0 data store 252 and caching the retrieved data into cache 

alternate embodiment, the well known simple network man- 276A 

agement protocol (SNMP) may be used for implementing \\ will be appreciated that the above -described event 

event notification in the feedback-based adaptive network of notification technique may be applied to any desired net- 

the present invention. Alternatively, event notification may work element within the network. Further, it will be appre- 

be implemented by utilizing IP sockets. 65 ciated that any description of hardware and/or software 

One purpose of event handler 274A is to provide the features relating to a specific network element of the present 

ability for network element 204A to register with an event invention (such as, for example, element 204 A) may also be 
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extended to other network elements in the network (e.g., Ethernet interfaces, frame relay interfaces, cable interfaces, 

208A, 208B, 204B). DSL interfaces, token ring interfaces, and the like. In 

Generally, the dynamic feedback-based adaptive network addition, various very high-speed interfaces may be pro- 
element of the present invention may be implemented using vided such as fast Ethernet interfaces, Gigabit Ethernet 
software and/or hardware. For example, it can be imple- s interfaces, ATM interfaces, HSSI interfaces, POS interfaces, 
mented in an operating system kernel, in a separate user FDDI interfaces and the like. Generally, these interfaces 
process, in a library package bound into network may include ports appropriate for communication with the 
applications, on a specially constructed machine, or on a appropriate media. In some cases, they may also include an 
network interface card. In a specific embodiment of this independent processor and, in some instances, volatile 
invention, the technique of the present invention is imple- 1Q RAM. The independent processors may control such com- 
mented in software such as an operating system or in an munications intensive tasks as packet switching, media 
application running on an operating system. control and management. By providing separate processors 

A software or software/hardware hybrid of the feedback- for the communications intensive tasks, these interfaces 

based adaptive network element of this invention is prefer- allow the master microprocessor 62 to efficiently perform 

ably implemented on a general-purpose programmable 15 routing computations, network diagnostics, security 

machine selectively activated or reconfigured by a computer functions, etc. 

program stored in memory. Such programmable machine Although the system shown in FIG. 5A is one specific 

may be a network device designed to handle network traffic. router of the present invention, it is by no means the only 

Such network devices typically have multiple network inter- router architecture on which the present invention can be 

faces including frame relay and ISDN interfaces, for 20 implemented. For example, an architecture having a single 

example. Specific examples of such network devices include processor that handles communications as well as routing 

routers and switches. For example, the adaptive feedback- computations, etc. is often used. Further, other types of 

based network of this invention may include specially interfaces and media could also be used with the router, 

configured routers such as specially configured router mod- Regardless of network device's configuration, it may 

els 1600, 2500, 2600, 3600, 4500, 4700, 7200, 7500, and 25 employ one or more memories or memory modules (such as, 

12000 available from Cisco Systems, Inc. of San Jose, Calif. for example, memory block 65) configured to store data 

A general architecture for some of these machines will and/or store program instructions for the general-purpose 

appear from the description given below. In an alternative network operations and other specific functions described 

embodiment, the adaptive feedback-based network may be herein. The program instructions may control the operation 

implemented via a general -purpose network host machine 30 of an operating system and/or one or more applications, for 

such as a personal computer or workstation. Further, the example. The memory or memories may also be configured 

invention may be at least partially implemented on a card to store: current and updated operating information relating 

(e.g., an interface card) for a network device or a general- to the operation of the device, event notification messages, 

purpose computing device. device configuration information, program instructions for 

For example, the network element 204A of FIG. 2 may be 35 implementing event notification service, program instruc- 

a router, such as the router 10 illustrated in FIG. 5A of the tions for automatically and dynamically re-configuring the 

drawings. Referring to FIG. 5A, a router 10 is shown which device using updated control information, etc. 

may includes a master central processing unit (CPU) 62, Because such information and program instructions may 

interfaces 68, and a bus 15 (e.g., a PCI bus). When acting be employed to implement the systems/methods described 

under the control of appropriate software or firmware, the 40 herein, the present invention relates to machine readable 

CPU 62 is responsible for such router tasks as routing table media that include program instructions, operating 

computations and network management. It may also be information, etc. for performing various operations 

responsible for reporting operating information (relating to described herein. Examples of machine-readable media 

the router 10) to one or more external devices, retrieving include, but are not limited to, magnetic media such as hard 

new or updated control information from an external data 45 disks, floppy disks, and magnetic tape; optical media such as 

source, caching the retrieved control information, receiving CD-ROM disks; magneto-optical media such as floptical 

event notification messages, generating event messages disks; and hardware devices that are specially configured to 

(relating to the status of router 10), etc. CPU 62 preferably store and perform program instructions, such as read-only 

accomplishes all these Junctions under the control of soft- memory devices (ROM) and random access memory 

ware including an operating system (e.g., the Internetwork 50 (RAM). The invention may also be embodied in a carrier 

Operating System (IOS®) of Cisco Systems, Inc.) and any wave travelling over an appropriate medium such as 

appropriate applications software. CPU 62 may include one airwaves, optical lines, electric lines, etc. Examples of 

or more processors 63 such as a processor from the Motorola program instructions include both machine code, such as 

family of microprocessors or the MIPS family of micropro- produced by a compiler, and files containing higher level 

cessors. In an alternative embodiment, processor 63 is 55 code that may be executed by the computer using an 

specially designed hardware for controlling the operations of interpreter, 

router 10. In a specific embodiment, a memory 61 (such as Data Store 

non- volatile RAM and/or ROM) also forms part of CPU 62. As depicted in FIG. 2, data store 252 provides memory for 

However, there are many different ways in which memory storing current network operating information reported from 

could be coupled to the system. Memory block 61 may be 60 one or more of the network elements. The data store also 

used for a variety of purposes such as, for example, caching provides memory for storing updated network control infor- 

and/or storing data, programming instructions, etc. mation generated by the policy engine 254. The data store 

The interfaces 68 are typically provided as interface cards may exist on a stand alone device which includes its own 

(sometimes referred to as "line cards"). Generally, they CPU, and operating system (e.g. Windows NT), and 

control the sending and receiving of data packets over the 65 memory. Alternatively, the data store may reside as a virtual 

network and sometimes support other peripherals used with device at any one of the network elements, In a specific 

the router 10. Among the interfaces that may be provided are embodiment (not shown) a plurality of data store devices 
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may be provided in the network. Where multiple data store 
devices are provided, the information within each data store 
may be redundant (e.g. for back-up purposes or to provide 
rapid access by network elements). Alternatively, specific 
data stores may service selected portions of the networks in 
which case the information within each data store may not 
be redundant. 

Each data store may be implemented as a database, a flat 
file, a directory, data cache, or other data storage server 
implemented on top of some type of data storage media. In 
a specific embodiment, data store 252 of FIG. 2 is imple- 
mented as a directory server which supports the light-weight 
directory access protocol (LDAP). The LDAP protocol is 
commonly known to those having ordinary skill in the art. 

In a specific embodiment, the data store may be imple- 
mented using the Microsoft Active Directory (by Microsoft 
Corporation of Redmond, Wash.) or the Novell Directory 
(by Novell Corporation of Provo, Utah). One purpose of the 
data store in the feedback-control loop is to collect and store 
current network operating information for subsequent analy- 
sis. Collecting the operating information allows for flexibil- 
ity in the control mechanism of the feedback-based network. 

An example of data store 252 is shown in FIG. SB of the 
drawings. As shown in FIG. 5B, data store 252 includes a 
CPU 252C (which may be shared with other devices or 
agents), an event handling entity 252D, and a data storage 
block 252F having memory for storing network information. 
Memory block 252A may be used for storing operational 
information reported by the various network elements. This 
information is used by the policy engine (254, FIG. 2) to 
calculate updated control information related to the various 
network elements. The new or updated control information 
generated by the policy engine will be stored in block 252B 
of the data store. The event handler 252D monitors the data 
stored in block 252B as part of the event notification service. 
Policy Engine 

As described above, in one embodiment of the present 
invention, updated network conditions from the various 
network elements are constantly fed into data store 252. The 
information in the data store powers a policy engine which, 40 
in turn, effects changes in the network. When updated 
network conditions are fed into the data store, it is important 
that the policy engine be notified of the updated network 
operating information. The policy engine may either repeat- 
edly poll the data store for updated network data, or rely on 
an event service to be notified that a change in the network 
conditions has occurred. When alerted to changes in network 
conditions, the policy engine 254 is then triggered to per- 
form its application specific tuning function. 

The policy engine 254 is a decision-making (logical) 
component of the feedback-based adaptive network of the 
present invention. An example of a policy engine 254 is 
illustrated in FIG. 5C of the drawings. As shown in FIG. 5C, 
the policy engine 254 includes a policy server 254a, a CPU 
254g (which may reside at the policy server or other device), 
an event handling entity 254/, and a plurality of application 
specific plug-in policies 2S4th-e. An application specific 
policy is decision tree that allows the policy server to make 
a decision based upon measured variables and conditions. 
The definition of "policy" varies based upon the perspective 
of the user. In the case of management and control of 
network elements, a policy is a corrective action which is 
used to restore the network element to a pre-determined 
state. 

In a specific embodiment, the policy engine may be 
implemented on a stand alone device which includes CPU, 
an operating system such as, for example, Solaris 
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(manufactured by Sun Microsystems of Mountain View, 
Calif.) or Windows NT (manufactured by Microsoft Corpo- 
ration of Redmond, Wash.), memory, and a storage device 
such as disk storage for storing a policy library of plug-in 
policies. Alternatively, the policy engine may be imple- 
mented as a virtual device which resides on one of the 
network elements such as, for example, a router. 
Additionally, the policy engine may be implemented with 
neural networks or with other artificial intelligence tech- 
nologies. 

The overall architecture of the policy engine is such that 
it allows for application specific plug-in policies to be added 
or deleted from the system. The policy server design is made 
modular so that decision tree modules can be added and 
deleted at will without disruption to the policy engine. Each 
application specific plug-in policy module (254b-2S4e) may 
be implemented as a plug-in to the policy server 254a. 
Application specific policy plug-ins include frame relay 
policies, AIM policies, dial up policies, traffic shaping 
policies, quality of service (QoS) policies, security policies, 
admin policies, SLA policies, etc. Examples of various 
application specific policy plug- ins are shown in FIG. 5C, 
and include an ATM policy plug-in 254£>, a frame relay 
policy plug-in 2546, a dial up policy plug-in 2546, and a 
security policy plug-in 254e. The examples shown in FIG. 
5C merely illustrate some of the various application specific 
policy plug-ins which may be attached to the policy server 
254A. 

Each application specific plug-in policy module may 
include one or more policies. For example, the frame relay 
policy plug-in 254c may include a first policy for controlling 
the CIR parameter of a frame relay circuit, and may include 
a second policy for controlling the EIR parameter of a frame 
relay circuit. Each policy contains a specific set of rules for 
analyzing specific information from selected network 
elements, and for generating updated control information in 
response to the analysis of the gathered information. The 
policy may include protocol specific rules, business logic 
rules, event notification rules, etc. Further, as described in 
greater detail below, the pobcies may be dynamically 
re-configured during run-time, meaning that a specific 
policy may be dynamically modified in situations, such as, 
for example, where it is determined that the current policy 
for controlling an aspect of network performance is ineffec- 
tive. 

In a specific embodiment, the policies which form part of 
the policy engine may be stored in a policy library. Each 
policy may be implemented as a decision tree comprised of 
nodes, wherein at each node an action may be performed if 
specified criteria is satisfied. The policy may be configured 
as an application or program which runs on top of the 
operating system of the policy server. The policy engine 
traverses the decision trees of the various policies. Policies 
may be used to monitor, manage, and/or control a variety of 
network characteristics including quality of service (QoS), 
security, access, usage, etc. 

Thus, for example, the policy engine may be used to 
implement policies at one end of the frame relay link based 
upon conditions at the other end of the link. If a link that is 
downstream from a switching network experiences 
congestion, the policy engine will dynamically control the 
upstream link to adapt to the network conditions so that the 
downstream network does not drop any packets. 

FIG. 12 shows an example of a flow diagram representing 
a CIR policy (or decision tree) for a frame relay network. 
The frame relay CIR analysis policy 1200 is responsible for 
analyzing CIR information reported to the data store, and for 
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generating updated CIR. values based upon the analysis of 
the reported information. The updated CIR data may then be 
used by various elements in the network to modify or affect 
each element's respective behavior or operation (thereby 
affecting operation of the network). In this way, the network 
elements are able to automatically and dynamically adapt to 
changing network conditions. 

In a specific embodiment, each block within the flow 
diagram of FIG. 12 represents one or more nodes in a policy 
tree of the frame relay CIR policy 1200. The policy 1200 of 
FIG. 12 may be traversed by a policy server which has been 
configured to analyze each node in the policy tree and take 
appropriate action in response to the analysis. An example of 
a policy analysis procedure is shown in FIG. 11 of the 
drawings. 

FIG. 11 shows an example of a flow diagram of a policy 
analysis procedure 1100 which may be used for traversing 
nodes in a policy tree such as the policy tree described in 
FIG. 12. At 1102, a specific application policy is loaded into 
the policy server for execution. The application specific 
policy may be automatically loaded upon on initialization of 
the policy analysis procedure, or may be loaded subse- 
quently upon the occurrence of an event, such as, for 
example, the execution of a specific user application. In a 
specific embodiment, the policy analysis procedure 1100 is 
a multiple threaded process with each thread running its own 
application specific policy. Alternatively, the policy analysis 
procedure 1100 may be implemented as multiple processes 
or as a single threaded process with multiple concurrent 
runtime instances. It will be appreciated that either of these 
embodiments allows for multiple policy processes to be 
running concurrently in order to dynamically control various 
aspects of the network performance. 

Starting at the top of policy tree (1104), the current node 
in the policy tree is read (1106). If the current node is a read 
node (1108), then the policy server performs the specified 
read operation (1120). If the current node is a write node 
(1110), the policy server performs the specified write opera- 
tion (1122). If the current node is a script node (1112), the 
policy server runs the specified script (1124). A script node 
may be composed of multiple read nodes, write nodes, state 
nodes, computation nodes, etc. Script nodes compute the 
next state in the policy tree based upon the results of the 
computation. If the current node is a compute node (1114), 
the policy server performs the specified computation (1126). 
If the current node is a state node (1116), the policy server 
branches to the appropriate node in the policy tree (1128). If 
the format or instructions at the current node are not 
recognized, an error is returned and the policy tree is exited 
(1118). Moreover, where an error occurs, the processing of 
the policy is aborted. 

After the policy analysis procedure has performed the 
appropriate action in accordance with the current node in the 
policy tree, a determination is made as to whether the current 
node is the last node in the policy tree (1130). If the current 
node is not the last node in the policy tree, the policy 
analysis procedure proceeds (1132) to the next node in the 
policy tree, whereupon the next node is processed as 
described above (e.g. starting at block 1106). 

If, however, the current node in the policy tree is the last 
node in the policy tree, at 1134, a determination is made as 
to whether the policy analysis procedure should be repeated 
for the currently loaded policy. In some instances, it may be 
desirable to have specific policies continuously running in 
order to provide continuous monitoring and/or updating of 
network parameters. In other instances, it may be desirable 
to have a specific policy procedure analysis concurrently 
running only while a specific user application is running. 
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If it is determined that the policy analysis procedure is not 
to be repeated for the currently loaded policy, the policy 
analysis procedure is exited. However, if it is determined 
that the policy analysis procedure is to be repeated for the 

s currently loaded policy, at 1136, a determination is made as 
to whether the current policy has been modified by other 
control elements in the network. As described in greater 
detail in a latter section of this application, a policy within 
policy engine 254 may be dynamically modified in order to 

10 alter the way in which that policy effects control of the 
network. In a specific embodiment, for example, when a 
specific policy has been modified, an associated register or 
flag may be set. At block 1136, this flag or register may be 
checked to determine if the code for the currently loaded 

15 policy has been modified. If it is determined that the 
currently loaded policy has been or is about to be modified, 
the modified policy is then loaded (1102) and executed by 
the policy server. If, however, it is determined that the 
currently loaded policy has not been or is not about to be 

20 modified, the policy analysis procedure returns to the top 
node in the policy tree (1104) and repeats the analysis 
procedure of the current policy as described above. 

By way of example, the policy analysis procedure 1100 of 
FIG. 11 will now be applied to the frame relay CIR policy 

25 tree of FIG. 12. The frame relay CIR policy analysis 
procedure of FIG. 12 may be used, for example, to provide 
updated CIR parameter data to frame relay network ele- 
ments 304A and 304B of FIG. 3 based upon the number of 
packets dropped on links B and C of FIG. 3. Using the 

30 technique of the present invention, adaptive frame relay 
parameter handling can be expanded to support complex 
situations without operator intervention. 

Referring to FIG. 12, at 1201, the frame relay CIR policy 
is loaded by the policy analysis procedure 1100. After the 

35 frame relay QR policy has been loaded by the policy server, 
at 1202, various parameters are initialized. The values used 
for parameter initialization may be derived, for example, 
from a configuration file associated with the frame relay CIR 
policy. The specific parameters initialized in box 1202 

40 describe a threshold value (representing a maximum allow- 
able value of dropped packets for a given link) a data source 
for retrieving network element information and for writing 
updated control information (e.g., data store, network 
element), and specific formulae used for computing updated 

45 QR values based upon the number of packets dropped from 
a particular link. 

After the initialization parameters have been set, at 1204, 
the packet dropped count data for link B is retrieved from the 
specified data source and assigned to the variable X. In a 

50 specific embodiment, the specified data source is data store 
352. In an alternate embodiment, the specified data source 
may be network element 304A. However, for purposes of 
this example, it will be assumed that the data source is data 
store 352. Next, the dropped packet count for link C is read 

55 (1206) from the data store and assigned to the variable Y 
At 1208, the cropped packet count values from links B 
and C are each compared with the threshold dropped packet 
count value (set during initialization at 1202). If the dropped 
packet count value for either of links B or C do not exceed 

60 the established threshold value, then it may be inferred that 
the current CIR values for links B and C are adequate for 
achieving a desired network performance which conforms 
with predetermined criteria or specified guidelines. In the 
example of FIG. 12, network performance is determined 

65 using predetermined criteria which is related to the threshold 
value of the dropped packet count for links B and C. Thus, 
if the dropped packet counts for links B and C conform with 
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(i.e., are less than or equal) the predetermined criteria 
specified by the threshold dropped packet count value, that 
particular aspect of network performance is determined to be 
adequate. Accordingly, the existing CIR values for links B 
and C need not be modified or updated at the present time. 
The CIR analysis then continues at block 1218 wherein the 
frame relay CIR policy procedure waits (1218) a predeter- 
mined time interval (V) (e.g. 5 sec. -30 sec.) before either 
repeating the procedure (1220) or exiting the procedure 
(1224). 

If either of the dropped packet count values from links B 
or C exceeds the threshold dropped packet count value, it 
may be inferred that at least one of the CIR values for links 
B and/or C is inadequate for maintaining a dropped packet 
count for each of the links below the threshold value. 
Accordingly, in order to adapt to this change in the network 
conditions, the CIR values for links B and C are recomputed. 

In order to re-compute the CIR values for links B and C, 
the current CIR values for these links are retrieved (1210) 
from either the data store or directly from the appropriate 
network elements. Next, the CIR value for link B is recom- 
puted (1212) based upon a specified formula which may be 
provided by, for example, a configuration file related to the 
frame relay CIR policy. Similarly, at 1214, the CIR value for 
link C is recomputed based upon the specified formula. 

An example of one formula which may be used for 
computing updated CIR values is: 

New CER value-old CIR value*(l+JV)*K, 

where fraction N=Dropped_Bits/Sec/CIR, 0<N<1, and Kis 
a predetermined constant (e.g. K=l) which may be dynami- 
cally adjusted to alter the ratio between the old QR value 
and the new CIR value for a specified link. As explained in 
greater detail in a latter section of this application, each 
policy within the policy engine may be dynamically modi- 
fied upon determining that the current policy procedure is 
ineffective in controlling an aspect of the network perfor- 
mance to conform with predetermined guidelines or criteria. 
Thus, in the example of FIG. 12, if it is determined that 
current formula used for re-computing the CIR values is 
ineffective in reducing the dropped packet count for links B 
and C, the formula may be dynamically and automatically 
altered, for example, by changing the value of the variable 
K. 

Once the updated CIR parameter values for links B and C 
have been computed (at 1212 and 1214), the updated CIR 
parameter values are then written (1216) into the data store 
352. The frame relay CIR policy procedure then waits 
(1218) a predetermined time interval (e.g. 0-30 minutes) 
before either repeating the procedure or exiting the proce- 
dure. 

After the predetermined time interval has elapsed, a 
determination is made as to whether the frame relay CIR 
policy procedure 1200 is to be repeated. This determination 
may be implemented using a variety of commonly known 
techniques, for example, by consulting a specific status flag, 
by polling, by receiving instructions from an external 
source, etc. If it is determined that the CIR policy procedure 
is to be repeated, at 1222, a determination is made as to 
whether the policy has been modified. In a specific 
embodiment, this determination is made by consulting a 
policy modification flag associated with the frame relay CIR 
policy. If, it is determined that the policy has not been 
modified, then the CIR policy procedure 1200 resumes at 
block 1204. 

However, if it is determined that the policy has been 
modified, the procedure resumes starting at block 1201, 
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whereupon the modified policy is loaded for execution. 
Additionally, the policy modification flag may be reset at 
this time. For example, if the formula for re -computing the 
CIR values has been modified at any time during execution 
of the CIR policy 1200, a policy modification flag would be 
set to indicate that the policy has been modified. Thereafter, 
if the CIR policy is repeated or subsequently executed, the 
modified formula will be loaded at initialization and will be 
used for computing the new CIR values for the appropriate 
links. 

FIG. 4 shows an alternate embodiment of the feedback- 
based adaptive network of the present invention. The net- 
work of FIG. 4 utilizes many of the novel concepts described 
above with respect to FIGS. 2 and 3. However, one differ- 
ence in the embodiment of the FIG. 4 is that the participating 
network elements (e.g., 404A, 404B, 408A, 408B) received 
their respective updated control information directly from 
the policy engine 454. Thus, for example, in one 
embodiment, the policy engine 454 directly controls each of 
the network elements by providing updated control infor- 
mation directly to the network elements. The policy engine 
may cache the updated control information into a local data 
cache (e.g. 27 6 A) at a network element. The network 
element may then retrieve the updated control information 
from its local cache and reconfigure itself using the retrieved 
updated control information. Alternatively, the policy engine 
may send a notification signal to selected network elements, 
advising each element that updated control information is 
available for that respective element. The network element 
may then retrieve the appropriate updated control informa- 
tion from the policy engine 454. 

FIGS. 6-10 illustrate examples of flow diagrams relating 
to various procedures associated with the adaptive feedback- 
based network illustrated in FIG. 2 of the drawings. 

FIG. 6 shows a specific embodiment of a flow diagram for 
an initialization procedure 600 of the present invention. The 
initialization procedure 600 may commence by initializing 
the various network control elements (602). As stated 
previously, the term "control element" refers to the addi- 
tional hardware and/or software control components for 
implementing dynamic feedback control of a conventional 
network, which may include, for example, event server 270, 
policy engine 254, ADMIN system 260, monitor system 
262, data store 252, etc. Additionally, the term "network 
element" refers to any hardware or software component of 
the adaptive feedback-based network of the present 
invention, including the control elements. At 604, the 
remaining (i.e. non-control) elements of the network are 
initialized. In a specific embodiment, each element may be 
initialized using existing control parameters which reside in 
a local cache (e.g., 276 A) or a configuration file (not shown) 
residing at the network element. Event registration is then 
initiated (606) for the various network elements (including 
network control elements) via the event handler associated 
with each element. The event registration procedure is 
described in greater detail with respect to FIG. 7. 

FIG. 7 shows a flow diagram of an event registration 
procedure 700 in accordance with a specific embodiment of 
the present invention. Event registration for a particular 
network element may be implemented via its associated 
event handler. In the example of FIG. 7, it is assumed that 
the event registration procedure 700 is being implemented at 
network element 204A of FIG. 2. 

According to a specific embodiment, the event handler 
274A may initially consult a local configuration file (not 
shown) in order to determine which events the network 
element is to register for at the event server 270. The 
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configuration file may be programmed using a command 
line interface terminal 206A. Alternatively, the event handler 
may be statically pre -configured to automatically register for 
specified events upon initialization. Thus, at 702, the event 
handler 274A determines the particular events for which 5 
network element 204A is to be registered at the event server 
270. Thereafter, the event handler 274A registers (704) 
network element 204Afor notification of selected events, for 
example, by attaching to selected event channels at event 
server 270. As described previously, in a specific embodi- 10 
ment the event notification service is implemented utilizing 
a standardized CORBA event service API, commonly 
known to those skilled in the art. After the network element 
has registered with the event server for event notification, 
the network element is then ready to receive and react to 15 
event notification messages. Additionally the network ele- 
ment is able to report event occurrences (e.g. errors detected 
by the network element) to the event server 270, where other 
network elements have registered to be notified of such 
events. 20 

FIG. 8 shows a flow diagram of a network element 
reporting procedure 800 in accordance with a specific 
embodiment of the present invention. The network element 
reporting procedure may be initiated, for example, during 
initialization of the network element. As described in greater 25 
detail below, the network element reporting procedure 800 
is executed at the network element and provides a technique 
for causing the network element to report specified infor- 
mation of the network element to the data store. 

When the network element reporting procedure 800 is 30 
implemented by a specific network element, the network 
element first determines (802) the appropriate data store(s) 
for reporting its operating information. In one embodiment, 
the network element may determine the appropriate data 
stores for reporting its operating information by consulting 35 
a configuration file residing at the network element. In a 
specific embodiment, an automated approach using a mul- 
ticast mechanism for discovering the appropriate data stores 
may be implemented via additional software. The automated 
approach using multicast automates the data store selection 40 
process and may therefore be independent of the particular 
implementation of each data store. 

Once the appropriate data store(s) has been identified, the 
network element is then initialized (804) to communicate 
with the identified data store(s). In a specific embodiment 45 
where the data store is implemented as an LDAP directory 
service, a network element may be initialized to communi- 
cate with the data store utilizing LDAP function calls. The 
LDAP function calls are part of a standard API library which 
may be stored at the network element and used for commu- 50 
nicating with the LDAP directory server. In at least one 
embodiment of the present invention, the initialization of the 
network element to communicate with a data store includes 
performing a log-on procedure so that the network element 
is logged onto the specified data store(s). If the network 55 
element is unable to access (806) the identified data store, it 
will report (808) the error to event server 270, wait (809) a 
specified time period (e.g. 0-30 minutes), and then reattempt 
to communicate (804) with the identified data store(s). 

Once a communication link has been established between 60 
the network element and the identified data store(s), the 
network element computes and/or retrieves (807) specific 
information for reporting to the identified data store(s). For 
example, as shown in FIG. 3 various frame relay virtual 
circuit parameter values (e.g., CIR, EIR, dropped packets, 65 
etc.) associated with network element 304Aare obtained and 
reported to data store 352. 
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In a specific embodiment, the type of operating informa- 
tion which the network element is to report is specified in a 
configuration file located at the network element. This 
configuration file may be dynamically modified using the 
feedback technique of the present invention in a similar 
manner by which the control parameters of the network 
element are dynamically modified. In an alternate 
embodiment, the network element is hard coded to auto- 
matically report specified information to the data store upon 
initialization. Moreover, it will be appreciated that the 
technique of the present invention may be used to dynami- 
cally modify any file, state, parameter, etc. of any network 
element in the network. 

After the specified operating information has been 
retrieved and/or computed by the network element, the 
network element attempts to access (810) the identified data 
store(s) for reporting the information. If any one of the data 
stores is inaccessible, the network element reports the error 
(808) to the event server 270 via its respective event handler, 
and wait (809) a specified time period (e.g. 0-30 minutes) 
before re -attempting to access the data store. It is to be noted 
that the network element reporting procedure 800 may be 
implemented as a multi-thread process whereby each thread 
is used to report network element operating information to 
a respective data store, or whereby each thread is used to 
report a specific portion of operating information to a 
specified data store. Alternatively, the network element 
reporting procedure 800 may be implemented as multiple 
processes or as a single threaded process with multiple 
concurrent runtime instances. If one data store is inacces- 
sible while another data store is accessible by the network 
element, each runtime instance or thread of procedure 800 
may take different action as appropriate. 

If the network element is able to access a specified data 
store, the network element reports (814) its data or operating 
information to that data store, whereupon the information is 
stored at the data store. In the specific embodiment where 
the data store is implemented as an LDAP server, updated 
operating information provided by the network element may 
be stored in the data store by using an LDAP library call. 

The network element then waits (816) a specified time 
period before re-computing and/or retrieving updated oper- 
ating information to be reported to the data store(s). For 
example, in a specific embodiment of the present invention, 
the specified time period T (which may be referred to as a 
polling interval) may range from 0-30 minutes. However, it 
will be appreciated that the length of the polling interval may 
vary greatly and may be appropriately determined based 
upon the particular network in which the technique of the 
present invention is implemented. 

In at least one embodiment of the present invention, the 
network element continually reports updated operating 
information to the data store 252. In the event where the 
network element is unable to access the data store, the error 
will be reported to the event server which, in turn, will notify 
the appropriate control elements of the error so that the 
control elements may take appropriate action. 
Event Notification Service 

According to a specific embodiment of the present 
invention, the adaptive network relies on a policy engine that 
uses real-time network data (e.g. state data) to make policy 
decision for generating updated network control parameters 
to thereby effect changes in the network. Where the network 
data to be analyzed is obtained from the data store, it is 
important that the data in the data store be up-to-date at all 
times. In order for the data to be up-to-date, a notification 
scheme is provided both from the network elements) to the 
data store, and from the data store to the network elements). 
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As illustrated in FIG. 2, at least a portion of the network current or up to date, it is desirable that the policy engine and 

elements include an associated event handling entity or monitor device be notified in order to prevent these devices 

event handler which communicates with event server 270. from using the outdated or non-current data to dynamically 

The event handler may be implement via software, perform feedback control of various network parameters, 

hardware, or a hybrid combination of software and hardware s In a specific embodiment of the present invention, each 

and is configured to function as both an event notification network element which is configured to receive event noti- 

receiving entity and an event notification supplying entity fication messages uses an event notification response pro- 

for its associated network element (host device). More cedure for receiving and reacting to the event notification 

specifically, the event handler enables its host device to message. The event notification response procedure may be 

receive event notification messages relating to the occur- 10 configured as a multi-thread process which is described, for 

rence of one or more events for which the host device has example, in FIGS. 9Aand 9B of the drawings. Alternatively, 

registered to receive notification. Additionally, the event the event notification response procedure may be imple- 

handler is able to provide notification of events related to its mented as multiple processes or as a single threaded process 

host device to the event server. The event server may then with multiple concurrent runtime instances, 

broadcast notice of the event to other event handling entities 15 FIGS. 9A and 9B illustrate a specific embodiment for 

which have subscribed or registered to receive event noti- implementing a multi-thread process of an event notification 

fication messages relating to that particular event type. response procedure. Referring first to the Event Notification 

When an event notification message is distributed to any one Procedure 900A of FIG. 9 A, and using network element 

of the network or control elements, it is received by the 204A as an example, event handler 274A continually moni- 

respective event handler of that element. In a specific 20 tors (902) selected event notification channels at the event 

embodiment, event notification service may be implemented server to which that network element has attached. When an 

utilizing an a synchronous notification scheme. event notification message is received (902) at the network 

Thus, for example, event handler 272 which is associated element, the event handler then queues (904) the notification 

with data store 252 may monitor the availability of updated message in a notification queue. Although not specifically 

control information at data store 252, and notify the event 25 shown in FIG. 2, each network element which is configured 

server 270 of the availability of such data as it becomes to receive event notification messages includes an event 

available. The event server 270 may then send event noti- notification queue or other data structure for temporarily 

fication messages to selected network elements which have storing the event notification messages until that message 

registered to receive event notification relating to the par- can be processed 

ticular updated control information which has become avail- 30 FIG. 9B illustrates a specific embodiment of an Event 
able at data store 252. Using network element 204A as an Notification Response Procedure 900B of the present inven- 
example, the event notification message dispatched by event tion. The event notification response procedure 900B is 
server 270 will be received by event handler 274A. In a implemented by the network element which works in con- 
specific embodiment, the event handler queues and pro- junction with the event handling entity of that element for 
cesses each received event notification message. During 35 responding to the event notification message. At 912, the 
processing of the event notification message, the event event notification queue is checked for any event notification 
handler notifies the network element 204A of the event messages which may have been enqueued during the pro- 
occurrence, whereupon the network element may then take cedure of 900A. Assuming there is at least one event 
appropriate action. In this way, the event handler 274A notification message in the queue, the oldest event notifica- 
serves as an event notification receiving device. 40 tion message is dequeued (913) from the queue and ana- 
In addition to serving as an event notification receiving lyzed. Based on the event notification message, specific 
device, the event handler 274A may also function as an information relating to the event is determined (914). For 
event notification supplying device to the event server 270. example, where the event notification message relates to 
For example, if the communication link between the net- updated control information being available at data store 
work element 204A and data store 252 is down, the event 45 252, at 914, the specific control parameters which have been 
handler 274Amay send a message to the event server stating updated are determined from the event notification message, 
that network element 204A is unable to communicate with The network element then attempts to access (916) the 
data store 252. This message may, in turn, be distributed to data store 252 in order to retrieve the specified updated 
various other components of the system or network which control information. In the event that the network element is 
have subscribed to receive notification of this type of event 50 unable to access the data store, the event notification mes- 
occurrence. For example, ADMIN system 260 may be sage is enqueued (917) in the message notification queue, 
notified in order to inform a network administrator of the and the error is reported (916) to the event server via the 
problem. Additionally, where appropriate, the ADMRN sys- network element event handler. Thereafter, flow of the 
tem 260 may also inform users 202 and/or user 214 of the procedure resumes at 912, whereupon another attempt is 
problem. Further, the event server may also notify the policy 55 made to fully respond to the event notification message. In 
engine 254 and monitor device 262 of the problem. One a specific embodiment, any event notification messages 
reason for informing policy engine 254 and monitor device which have been re-queued (because, for example, they 
262 of this type of problem is to prevent these systems from were not able to be fully processed) are processed ahead of 
using erroneous data at data store 252 to perform feedback other event notification messages in the queue. For example, 
control of the various network elements. Thus, for example, 60 in a specific implementation, the event notification messages 
if network element 204A is unable to report its current are enqueued in order according to each message's respec- 
informalion to data store 252, the policy engine 254 should live arrival time at the network element, 
preferably be notified in order to prevent it from using It is to be noted that the error reported to the event server 
erroneous or out-dated data (relating to network element 270 (relating to the network element not being able to access 
204A) in calculating new control information for the net- 65 the data store) is forwarded for broadcast to any network 
work elements. The same reasoning also applies to monitor element which have registered to receive notification of such 
device 262. If the information within the data store is not events. For example, the error may be reported to the 
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administration system 260 in order to alert a system admin- 
istrator of the problem. Additionally, the error may be 
reported to the policy engine 254 in order to inform the 
policy engine that network element 204A is no longer 
reporting current information to the data store. In this way, 5 
the policy engine is prevented from generating new control 
information based upon erroneous or outdated data located 
at data store 252. 

Assuming, however, that the network element is able to 
access data store 252, at 918 the network element retrieves 10 
the specified updated control information from data store 
252. Any suitable mechanism may be used to retrieve the 
new values of the updated control information from the data 
store. In a specific example where the data store is imple- 
mented as an LDAP directory server, an LDAP library call 15 
may be used to retrieve the updated control information. 
Where the data store is implemented as a relational database, 
an SQL search command may be used for retrieving the 
updated control information. Alternatively, where the data 
store is implemented as a file, a read command may be used 20 
to retrieve the control information. Where the data store is 
accessible using a simple network management protocol 
(SNMP), a get-parameter command may be used for retriev- 
ing the updated control information. 

Once the updated control information has been retrieved 25 
from the data store, the data is validated (920) as a safety 
precaution in order to ensure that the updated control 
parameter values are within an allowable range or boundary 
specific to that particular network element. In a specific 
embodiment, the predetermined range or boundary criteria 30 
may be stored, for example, in a configuration file residing 
at the network element. In an alternate embodiment, the 
updated parameter data retrieved from the data store is 
dynamically validated based upon a platform evaluation 
performed by the network element. For example, the net- 35 
work element may execute a procedure for dynamically 
determining upper and lower bounds for a respective control 
parameters based upon its current operating condition and/or 
performance. The upper and lower bounds for these param- 
eters may then be used to validate the control information 40 
received from the data store. If the retrieved values from the 
data store are determined to be invalid, the network element 
may simply ignore the updated parameter data and continue 
to behave using its current control parameter information. 
Additionally, where the values in the data store are deter- 45 
mined to be invalid, the network element may report the 
error or problem to the event server 270, which may then 
forward the error information to other appropriate control 
elements for logging or responding to the error. 

Thus, at 922, a determination is made as to whether the 50 
retrieved updated control information is valid based upon 
the validation preformed at block 920. If the retrieved 
parameter data is not valid, the values are discarded and an 
error is reported (925) to the event server 270 for distribution 
to appropriate network elements. Thereafter, flow control of 55 
the procedure 900B resumes at block 912. If, however, it is 
determined that the retrieved parameter data is valid, at 924 
the newly retrieved control information is written in to the 
local cache or memory 276A of the network element. In a 
specific implementation, a "cached data" flag or register is 60 
set to indicate that new or updated control information exist 
within the local cache 276A. Thereafter, flow control of the 
procedure returns to block 912. 

In alternate embodiments of the present invention the 
event response procedure 900B may differ slightly depend- 65 
ing upon how tie adaptive feedback-based network of the 
present invention is implemented. For example, in a specific 
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alternate embodiment, the actual values relating to the 
updated control information are passed in the event notifi- 
cation message to the corresponding network element. Thus, 
in this embodiment, the actual values relating to the updated 
control information may be determined directly from the 
event notification message upon dequeuing the message 
from the notification queue. Accordingly, the network ele- 
ment need not retrieve the updated control information from 
the data store. 

After new or updated control information has been cached 
into the local cache of a respective network element, a 
network element parameter update procedure is used to 
configure or reconfigure the network element using the 
updated control information cached within the local cache. 

FIG. 10 shows a network element parameter update 
procedure 1000 in accordance with a specific embodiment of 
the present invention. Procedure 1000 may be implemented 
automatically by the network element upon determining that 
updated control information is available in its local cache. 
Initially, at 1002, the procedure waits until it is notified that 
new data has been cached into the local cache. In a specific 
embodiment this is implemented via a "cached data" register 
or flag. However, it will be appreciated by those having 
ordinary skill in the art that there are a variety of conven- 
tional techniques for determining whether new data has been 
cached into the local cache of the network element. 

If it is determined that new data has been written in to the 
local cache 276A, the newly cached data is retrieved (1004). 
The network element then automatically configures or 
reconfigures itself (1006) using the cached information. The 
cached information represents updated control information 
generated by the policy engine in response to changing 
network conditions. Typically, when the network element 
configures itself using the updated control information, its 
performance and/or operation is affected in some manner. 
This effect of the performance or operation of the network 
element will typically be reflected in the new operational 
information which the network element reports to data store 
252. This new information will, in turn, be analyzed by the 
policy engine 254, which may generate new control infor- 
mation in response to the newly reported information from 
the network element. In this way, feedback control of the 
network element is achieved. 

After the network element has been reconfigured utilizing 
the updated control information, the "cached data" flag or 
other indicator used for indicating new data cached within 
the local cache 27 6A may be reset Thereafter, the process 
returns to a previous state represented by block 1002. 

As described previously, the adaptive feedback-based 
network of the present invention includes an event notifi- 
cation service which is implemented via event server 270 
and the plurality of event handlers associated with the 
network and control elements. Event server 270 (FIG. 2) 
may be implemented as a separate device having at least one 
CPU and memory, or, alternatively, can be implemented as 
an application to run on top of the operating system of 
another device in the network. One responsibility of the 
event server is to manage the plurality of event channels 
which are used by the various event handling entities to 
transmit and receive event notification messages. When an 
event handler detects an occurrence of an event, the event 
handler reports the event to the event server 270 which, in 
turn, broadcasts an event notification message to selected 
network elements using a specific event channel. In a 
specific embodiment of the present invention, the event 
notification service is implemented using standardized 
CORBA event service APIs. 
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FIG. 15 shows an example of a flow diagram for a data 
store event handler reporting procedure 1500, in accordance 
with a specific embodiment of the present invention. Pro- 
cedure 1500 may be implemented via the event handling 
entity 272 residing at data store 252. One responsibility of 5 
event handler 272 is to continually monitor the data store for 
new or updated control information which has been gener- 
ated by the network elements or by the policy engine 254. 
When event handler 272 detects the occurrence or availabil- 
ity of a new control parameter, it notifies the event server to 
270 which distributes the event notification message onto 
the appropriate network element(s). In a specific 
embodiment, event handler 272 may be implemented as a 
process with multiple threads. Each thread may be respon- 
sible for monitoring and reporting a specific event occurring 15 
at data store 252. Alternatively, event handler 272 may be 
implemented as a single threaded process which allows for 
multiple runtime instances to be running concurrently. For 
example, one thread or runtime instance of event handler 
272 may continually monitor the data store for updated CIR 20 
data associated with a first subset of network elements in the 
network. A different thread or runtime instance of event 
handler 272 may continually monitor the data store for 
updated EIR parameters associated with a second subset of 
network elements. Thus, it will be appreciated that the data 25 
store event handler reporting procedure 1500 describes a 
monitoring and reporting technique which may be imple- 
mented by one of the multiple threads or run-time instances 
of event handler 272. 

Referring to FIG. 15, upon initialization of the event 30 
handler 272, or at some point thereafter, the event handler 
determines (1502) the particular event(s) to be monitored for 
reporting to event server 270. In a specific embodiment, this 
information may be determined by consulting a configura- 
tion file associated with data store 252. Alternatively, the 35 
event handler may be hard coded to automatically monitor 
specified events upon initialization. Additionally, once the 
specific event(s) to be monitored have been identified, the 
event handler determines the associated event channels) for 
attachment (to the event server) relating to the identified 40 
event(s) to be monitored. 

Once the event handler has determined the specific event 
channels for attachment, it attaches (1504) to the specified 
event channels at event server 270. In a specific 
embodiment, the event handler may attach itself to the 45 
specified event channels at the event server using standard- 
ized CORBAAPIs. Thereafter, at 1506, the event handler 
procedure opens a connection with the data store 252. In a 
specific embodiment, the connection with the data store is 
established using a Java naming and directory interface 50 
(JNDI). 

After a connection with the data store has been 
established, the event handler is then able to retrieve specific 
data from the data store in order to determine whether the 
specified data has been updated by the policy engine. In a 55 
specific embodiment, the particular data retrieved by the 
event handler is specified in the event handler programming 
instructions. In the example of FIG. 15, it is assumed that the 
event handler is responsible for reporting updated control 
information stored within data store 252. Accordingly, the 60 
event handler will retrieve (1508) the current control param- 
eter values reported by the various network elements to the 
data store, and will also retrieve (1510) the desired or 
updated control parameter values generated by the policy 
engine. For example, where the specific event relates to 65 
updated CIR values for the frame relay circuit associated 
with network element 204A(FIG. 2), the event handler will 
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retrieve the current CIR value reported from network ele- 
ment 204Ato the data store, and will also retrieve the desired 
CIR value for the frame relay circuit associated with element 
204A generated by the policy engine. At 1512, the current 
and desired control parameter values are compared in order 
to determine (1514) if the values have changed or have been 
modified by the policy engine. 

If it is determined that there is no change between the 
current and desired values of the specific control parameter 
being analyzed, the procedure waits (1518) a specified time 
period (e.g., 0-30 minutes) before repeating the analysis, 
starting at block 1508. In an alternate embodiment, this wait 
cycle may be replaced by another event service routine. 

If, however, it is determined that the current control 
parameter value reported from the network element differs 
from the desired control parameter values generated by the 
policy engine, the event handler will generate (1516) an 
event message. In a specific embodiment, this event change 
message may be forwarded to the event server 270 for 
distribution to other network elements. Thereafter, the event 
handler will wait a specified time period before repeating 
procedure 1500 starting at block 1508. 
Monitor System and ADMIN System 

As described previously, at least one embodiment of the 
adaptive feedback-based network of the present invention 
includes a monitor system (262, FIG. 2). As described in 
greater detail below, monitor system 262 may be configured 
to serve a variety of purposes, and therefore may be referred 
to by different names, depending upon the particular func- 
tion it is performing. Like the policy engine, the monitor 
system 262 may be implemented as a separate machine 
having memory, an operating system (e.g. Windows NT, 
UNIX, LINUX, DOS, etc.), and at least one CPU. 
Alternatively, monitor system 262 may be implemented on 
top of the operating system of another one of the network 
elements (including the control elements). In this latter 
embodiment, it is possible for the monitor system to share 
the event handler device associated with that network ele- 
ment. In a specific embodiment, the monitor system 262 
may be implemented in Java, and run on one of the above- 
described platforms. Additionally monitor system 262 may 
include a plurality of business application plug-ins for 
analyzing various aspects of network performance or other 
network characteristics. 

In a specific embodiment, monitor system 262 utilizes the 
policy engine 254 for running the plurality of plug-in 
applications associated with the monitor system. Thus, 
according to one embodiment (not shown), monitor system 
262 may be configured to run on top of the policy engine 
254. In this embodiment, the monitor system may not 
include a separate event handler device, but instead may use 
the event handler device associated with the policy engine. 

Each of the business application plug-ins utilized by the 
monitor system 262 may be used to evaluate a specific set of 
characteristics of the network. For example, monitor system 
262 may be used to evaluate performance criteria of the 
various network elements to determine whether the service 
quality provided by the service provider conforms with the 
standards set forth in a Service Level Agreement (SLA) 
established between the service provider and the end user or 
consumer. Alternatively, using different plug-in applications, 
monitor system 262 may be used for performance 
monitoring, billing, configuration management, security 
violation reporting, fault management, etc. Moreover, dif- 
ferent plug-in applications may run concurrently to allow 
monitor system 262 to analyze different aspects of the 
network simultaneously. 
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FIG. 13 shows a flow diagram of a neiwork performance tive feedback-based network of the present invention, 

quality monitor procedure 1300 in accordance with a spe- Additionally, the administration system 260 provides an 

cific embodiment of the present invention. According to one external interface to remote users, (e.g., users 202, 214, FIG. 

embodiment, the network performance quality monitor pro- 2). Using the ADMIN system 260, a remote user is provided 

cedure is a multi-thread process which is implemented by 5 with the ability to perform configuration and manipulation 

the monitor system 262. Alternatively, the network perfor- of the elements within the network. The ADMIN 

mance quality monitor procedure may be implemented as a system 260 may be implemented as a separate machine 

single threaded process which allows for multiple runtime ft™* mc ™£ » "f ' T^^Sn 

instances of the process to be running concurrently. "^\"^ °2 ' T\A at least one CPU. 

A j- , f J-,, . . r u Alternatively, ADMIN system 262 may be implemented on 

Accordingly, a variety of differs network characterises 10 of ^ ^ of one J ^ m± 

may be analyzed concurrently by the monitor system 262. (il £ ludm | £ elements) . 
For each thread or runtime instance of the monitoring nG u fl flow ^ of an admin procedure 
procedure 1300, a specific procedure or business application 1400 in accordance with a specific embodiment of the 
plug -in for analyzing an aspect of network characteristics is prcscnt invcntion> admin procedure 1400 is imple- 
loaded (1301) for execution. At 1302, various initialization is me nted by ADMIN system 260, and may be implemented as 
procedures are performed, which may include locating and a mu lti-thread process. Alternatively, the admin procedure 
attaching to a "data source" for retrieving data which is to be 1400 may be implemented as a single threaded process 
analyzed, determining the specific network parameters which allows for multiple runtime instances of the process 
which are to be analyzed, retrieving predetermined network to be running concurrently. As described previously, the 
criteria, etc. The initialization information may be obtained, 20 ADMIN system 260 may be used to dynamically modify 
for example, by consulting a configuration file associated specific policies within the policy engine 254. 
with the particular business application plug-in which is In one embodiment of the present invention, policies in 
loaded. Alternatively, the initialization may be included the control of WAN services are essentially treated as static 
within the program instructions of the loaded plug -in appli- entities. However, in alternate embodiments, a mechanism is 
cation. For example, in a specific embodiment, the data 25 provided for allowing these policies to adapt to changing 
source for retrieving the network parameter information to network conditions in order to enable the network to adapt 
be analyzed is the data store which may be accessed, for to changing network conditions. Networks that adapt to 
example, using a directory access protocol. The specific changing conditions are very advantageous in fulfilling 
information to be analyzed from the data store may include, Service Level Agreements (SLA) in WAN networks, 
for example, reported CIR and EIR values from each of the 30 Moreover, a dynamic, policy-enabled, adaptive network can 
links A, B, C, D, (FIG. 2). The predetermined network be a self-healing, maintenance-free network, 
criteria may include, for example, specific CIR and EIR In a specific embodiment, there are at least three tech- 
values derived from the Service Level Agreement. niques for achieving modification of a policy within the 

In a specific embodiment, the network quality monitor policy engine 254. A first technique is for a remote user to 

system 262 includes functionality to gather information 35 dynamically modify the policy via ADMIN system 260. A 

from the data store and functionality to perform quality second technique is for a system administrator to modify the 

metrics calculation process. Block 1304 describes the net- policy via local terminal 266. A third technique to enable the 

work statistics gathering functionality. Basically, network ADMIN system 260 to automatically and dynamically 

statistics or other characteristics are gathered or retrieved modify a policy within the policy engine using artificial 

from one or more data sources. It is to be noted that the data 40 intelligence and/or fuzzy logic to determine the specific 

source may include any network element or control device policy modifications. The admin procedure 1400 of FIG. 14 

within the network. In a specific embodiment, the network provides an example of how these various techniques are 

statistics are retrieved from the data store. implemented at the ADMIN system 260. 

The quality metrics calculation functionality is described In the specific embodiment of the FIG. 14, admin proce- 

in block 1306. The network statistics or other characteristics 45 dure 1400 is responsive to either a input from a user (1402) 

which have been retrieved from the data store are then or an input from the monitor system 262 for modifying a 

compared against pre-established criteria to determine policy within the policy engine 254. If input is received from 

(1308) if the current network quality (relating to the par- a user, it will be assumed (for purposes of this example) that 

ticular aspect of the network being analyzed) is within the the user has provided a request to make a specific policy 

acceptable bounds as established by the predetermined cri- 50 modification, and has included the specific policy modifi- 

teria. cations to be performed along with the request. In this 

If it is determined that the currently analyzed network example, a user may be user 202 of FIG. 2, or may be a 
statistics are within the acceptable bounds as defined by the system administrator accessing ADMIN system via local 
predetermined network criteria, the monitor procedure 1300 console 266. At 1404, admin procedure 1400 determines 
waits (1312) a specified lime interval (e.g., 0-30 minutes) 55 whether the user has permission to modify or change the 
before repeating the analysis starting at block 1304. If, specified policy. For example, an access list may be con- 
however, it is determined that the current network statistics suited to determine if the user has authority to make the 
do not meet the specified predetermined criteria, the prob- proposed policy modification. If it is determined that the 
lem is reported (1310) to the ADMIN system 260 for user does not have authority to make the proposed 
handling. Thereafter, the monitor procedure 1300 waits 60 modification, at 1408, an unauthorized request message is 
(1312) a specified time interval before repeating the returned to the user, whereupon the procedure 1400 resumes 
analysis, starting at block 1304. Further examples of the at block 1402. If, however, the user is authorized to make the 
network quality monitor procedures which may be run by proposed policy modification, the specified policy within the 
monitor system 262 are provided in the descriptions of policy engine is modified (1406) (e.g. via ADMIN system 
FIGS. 16-18. 65 260) in accordance with the proposed policy modification 

Monitor system 262 and ADMIN system 260 work specified by the user. Thereafter, admin procedure 1400 

together to provide administrative functionality to the adap- resumes at block 1402. 
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In addition to responding to input from a remote user, initialization configuration file related to monitor system 

admin procedure 1400 is also responsive to input from 1662. Alternatively, notice of the initiation of the video 

monitor system 262. Thus, when a reported problem from conference application may be provided by either one of the 

monitor system 26.2 is received (1410) at ADMIN system users to the ADMIN system 1660. The ADMIN system then 

260, the admin procedure notifies (1412) the system admin- 5 instructs the monitor system 1662 to load and execute the 

istrator of the reported problem via terminal 266. The system CIR policy monitor procedure. 

administrator is then able to analyze the problem and make One purpose of the frame relay CIR policy (implemented 

modifications to the policy engine to correct the reported by policy engine 1654) is to monitor the number of packets 

problem. dropped on selected links in the network, and to adjust or 

Illustrative Example 10 modify the CIR parameter values on these links dynamically 

FIGS. 16-18 provide an illustrative example of how the and automatically in response to changing network condi- 

various network elements of FIG. 16 interact with each other tions. One purpose of the CIR policy monitor procedure 

to form the feedback-based adaptive network of the present (implemented by monitor system 1662) is to evaluate the 

invention. effectiveness of the frame relay CIR policy. Thus, both 

Referring to FIG. 16, a frame relay virtual circuit is shown 15 procedures/policies may run concurrently and, if desired, 

connecting userl (1602) with user2 (1620). Userl commu- continuously. 

nicates with a first router 1604 via link A. In the example of At 1706, each of the links A, B, C, D of FIG. 16 reports 

FIG. 16, router 1604 may be managed by a first service the number of packets dropped on that link (typically 

provider (SPI). Router 1604 communicates with a frame reported as the number of packets dropped during a specified 

relay cloud 1612 via link B and switch 1612. The frame 20 time period) to data store 1652. The frame relay CIR policy 

relay cloud 1610 is managed and maintained by a service at the policy engine 1654 uses this data to generate (1708) 

provider such as AT&T. The frame relay cloud 1610 com- updated CIR parameter values for each of the respective 

municates with a second router 1614 via link C and switch links. The updated CIR parameter values generated by the 

1613. The second router 1614 may be managed by a second policy engine are then written (1710) into the data store 

service provider (SP2). User 1620 communicates with router 25 1652. The event handler 1672 identifies the updated CIR 

1614 via link D. Using the network illustrated in FIG. 16, parameter values as new events, and notifies (1712) the 

various aspects of the present invention will now be appropriate network elements in the network of changed 

described by way of example in which a video conference is conditions in the network. Notification of the appropriate 

established between userl (1602) and user2 (1620). The network elements may be accomplished via the event server 

video conference example is described in greater detail with 30 1670, which may broadcast the event notification message 

respect to FIGS. 17 and 18 of the drawings. relating to the changed network conditions to those network 

FIG. 17 shows a flow diagram of how the feedback-based elements which have registered to receive this type of event 

network of FIG. 16 adapts to changing conditions in the notification message. 

network as a video conference is initiated between userl and Once the appropriate network elements have been notified 

user2. A video conference application between userl and 35 of the changed network conditions, each of the appropriate 

user2 is one example of a user application which may network elements may retrieve its respective updated CIR 

require additional bandwidth in order to provide a satisfac- parameter information from the data store 1652, and may 

tory level of quality for using the application to service then update (1714) its configuration utilizing the updated 

multiple users across the network. Thus, the video confer- CIR parameter information retrieved from the data store, 

ence example may be abstracted to be applied to any user 40 Thus, for example, the CIR values used by the router one 

application requiring additional network resources to pro- (1604, FIG. 16) may be modified using the updated CIR 

vide a satisfactory level of quality for the application to run parameter data to increase or decrease data traffic, 

over a network environment. Presumably, the updating of the CIR parameter values in 

As shown in FIG, 17, when a video conference between each of the selected network elements will affect the number 

userl and user2 is initiated (1702), the network may respond 45 of packets dropped on each of the links associated with these 

by initiating one or more bandwidth policies at the policy network elements. Thus, after the appropriate network ele- 

engine 1654, and may also respond by initiating one or more ments have been updated or re-configured utilizing the 

policies/procedures at the monitor system 1662. Thus, at updated CIR parameter values, the adaptive feedback- 

1704, the frame relay CIR policy is initiated at the policy control process resumes at block 1706, whereupon each of 

engine 1654, if this policy has not already been initiated. For 50 the links A, B, C, D provides updated information to the data 

example, in a specific embodiment of the present invention, store relating to the respective number of packets dropped at 

the frame relay CIR policy is loaded at initialization of the each link. This updated information is then analyzed by the 

policy engine according to instructions contained in a con- policy engine to generate new CIR parameter values, (if 

figuration file. Once loaded, this policy may run continu- necessary) to be implemented by the appropriate network 

ously and concurrently with other polices and/or user appli- 55 elements. This adaptive feedback-control process continues 

cations. In an alternate embodiment, when the user 1602 until the reported number of packets dropped by each of the 

initiates a video conference with user 1620, this information respective links conforms with predetermined criteria. When 

is passed to ADMIN system 1660. Recognizing that the this occurs, the policy engine may still evaluate the number 

video conference application may require an increase in of packets dropped at each respective link, but it will no 

allotted bandwidth, ADMIN system 1660 instructs policy 60 longer need to generate new CIR parameter values since the 

engine 1654 to initiate the frame relay CIR policy. current network parameters will reflect that the network has 

While the frame relay CIR policy is being initiated by the adequately adapted to the current network conditions. In an 

policy engine at 1704, a CIR policy monitor procedure is alternate embodiment, the policy engine still generates the 

concurrently initiated (1716) at monitor system 1662, if this updated CIR parameter values (even if these values are the 

procedure has oot already been initiated. The monitor sys- 65 same as the values reported by the network elements), and 

tem 1662 may load the CIR policy monitor procedure at writes these values into data store 1652. However, the event 

initialization in accordance with instructions contained in an handler 1672 recognizes that the current (i.e. reported) CIR 
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values are the same as the desired (i.e. updated) CIR values, parameter values. An example of how the frame relay CIR 

and does not notify the network elements of the event. Event policy may be modified is discussed previously, with respect 

notification will be triggered when the event handler 1672 to FIG. 12. Using internal logic, the variable K (taken from 

detects a difference between the current and desired CIR the formula provided in the description of FIG. 12) may be 

values. 5 incremented by a fixed amount (e.g., 0.1-1 .0) if it is detected 

In the CIR policy monitor procedure of FIG. 17, the that the dropped packet count for a respective link exceeds 

quality monitor system 1662 (FIG. 16) may concurrently the predetermined threshold value despite the current frame 

and continuously monitor the effectiveness of the frame relay CIR policy's attempt to reduce the dropped packet 

relay CIR policy implemented by the policy engine. In the count. 

example of FIG. 17, the effectiveness of the frame relay CIR 10 Thus, in a specific embodiment, the policy -based adaptive 

policy is measured by analyzing the number of packets control technique of the present invention continually tunes 

dropped at each of the respective links A, B, C. D, and at least a subset of network elements in the network. The 

comparing this data to predetermined criteria or guidelines. tuning of a network element may then affect the policy that 

Thus, for example, at 1718, the reported number of packets was used to tune the network device. The modified policy is 

dropped for links A, B, C, D are analyzed and compared to 15 then used to effect future changes in the network elements, 

a predetermined threshold in order to evaluate the effective- This process repeats itself as the network adapts to changing 

ness of the frame relay CIR policy implemented by the network conditions. 

policy engine. A determination is then made (1720) as to It will be appreciated that, since the policy engine 1654 

whether the frame relay CIR policy is effective in maintain- and quality monitor 1662 may each be implemented as 

ing the number of dropped packets on each or any of the 20 multi-thread processes or single thread processes with mul- 

respective links below the predetermined threshold value. If tiple runtime instances, other policies and/or quality mooi- 

it is determined that the current frame relay CIR policy is toring procedures may be running concurrently with the 

effective in maintaining the number of dropped packets on frame relay CIR policy and CIR policy monitor procedure 

each of the respective links below a predetermined described in FIG. 17. An example of a concurrent quality 

threshold, the quality monitor system 1662 may wait (1722) 25 monitoring procedure implemented by quality monitor sys- 

a specified time interval (e.g., 0-30 minutes) before tem 1662 is shown in FIG. 18 of the drawings, 

re-evaluating the effectiveness of the current frame relay FIG. 18 shows an example of a flow diagram for a Service 

CIR policy by analyzing newly updated information relating Level Agreement (SLA) analysis procedure 1800 which may 

to the number of packets dropped at each of the respective be implemented by the monitor system 1662 of FIG. 16. One 

links, 30 purpose of the SLA analysis procedure is to monitor various 

If, however, it is determined that the current frame relay aspects of the frame relay virtual circuit (e.g., CIR, EIR, 

CIR policy is not effective in maintaining the number of dropped packets, Be, Be, etc.) to ensure that these param- 

packets dropped at any of the links A, B, C, D below a eters fall within specified guidelines set forth in the Service 

predetermined threshold, then at 1724, a determination is Level Agreement established between the service provider 

made as to whether the frame relay CIR policy should be 35 and the user or client. The SLA analysis procedure may be 

re-evaluated. It may preferable to wait a specified amount of implemented, for example, upon initialization of the monitor 

time in order to allow the adaptive feedback process of the system 1662. The specific guidelines or criteria set forth in 

present invention to arrive at a steady state. Accordingly, in the Service Level Agreement may be stored, for example, in 

a specific embodiment of the present invention, the policy a configuration file residing at the monitor system 1662. A 

implemented by the policy engine may be allowed to 40 description of the service level agreement analysis proce- 

execute a number of times before action is taken to modify dure 1800 is provided below using the network example of 

the policy. For example, the current policy implemented by FIG. 16. 

the policy engine, even if judged ineffective, may be allowed Referring to FIG. 18, at 1804, each of the links A, B, C, 

to execute from 0-5 hours before action is taken to modify D (FIG. 16) reports its respective service level parameter 

the policy. Alternatively, the current policy may be 45 data to data store 1652. In a specific embodiment of the 

re-evaluated if it is determined that the current policy is present invention, the service level parameter data is a subset 

improving an aspect of the network performance. For of the state data or other information reported by each of the 

example, if the number of reported packets dropped for one links to the data store. The reported service level parameters 

or more of the respective links show a reduction compared are then analyzed (1806) by the monitor system and com- 

to that of previous reports, the current frame relay CIR 50 pared to values specified by the Service Level Agreement, 

policy may be allowed to continue without modification. The corresponding values specified by the Service Level 

Accordingly, if is determined that the current frame relay Agreement may be stored, for example, in a configuration 

CIR policy is to be re-evaluated, monitor system 1662 waits file which is associated with the service level agreement 

(1722) a specified time interval before re -evaluating the analysis procedure 1800. 

effectiveness of the policy. However, if it is determined that 55 A determination is then made (1808) as to whether the 

the current frame relay CIR policy is not to be re-evaluated reported service level parameters associated with the virtual 

at 1726, the ADMIN system 1660 is notified of the ineffec- circuit being analyzed meet or exceed the corresponding 

tive frame relay CIR policy. Thereafter, at 1728, the frame values or criteria specified by the Service Level Agreement, 

relay CIR policy may be dynamically modified via ADMIN If it is determined that the reported service level parameters 

system 1660. As described previously, the dynamic modi- 60 do meet or exceed the corresponding values or standards 

fication of a policy within the policy engine may be imple- specified by the Service Level Agreement, the monitor 

mented manually by a system administrator via console device 1662 waits (1810) a specified time interval (e.g., 

1666 or, alternatively, it may be implemented automatically 0-30 minutes) before reanalyzing the virtual circuit based 

by the ADMIN system using artificial intelligence and/or upon updated service level parameters reported (1804) from 

fuzzy logic. In the current example, the frame relay CIR 65 the circuit elements. 

policy may be dynamically modified by modifying the If , however, it is determined that the reported service level 

formula which the policy uses to compute the updated CIR parameters do not meet or conform with the corresponding 



06/23/2004, EAST Version: 1.4.1 



US 6,539,427 Bl 

33 34 

values or standards specified by the SLA, a determination is 4. The method of claim 1 wherein said dynamically 

then made (1812) as to whether the virtual circuit should be configuring includes dynamically configuring said network 

reanalyzed using the service level agreement analysis pro- element using said at least one control parameter to thereby 

cedure 1800. There may be a variety of reasons for deciding affect operating parameter information reported to said data 

to repeat a specific analysis procedure at monitor system 5 store. 

1662 before reporting a detected problem to the ADMIN 5. The method of claim 1 wherein said control inform a - 

system 1660. For example, it may be desirable to wait a lion is retrieved from said data store, 

specified time period before reporting an error or modifying 6. The method of claim 1 wherein said network element 

a policy in order to allow the feedback-based control net- includes a data structure, and wherein said method includes 

work of the present invention to adapt to the changing storing said retrieved updated information in said data 

network conditions and arrive at a steady state. A more structure. 

detailed discussion of this topic may be found in the dis- 7. The method of claim 6 further including using the data 

cussion relating to block 1724 of FIG. 17. If it is determined stored within said data structure to dynamically configure 

that the service level parameters should be reanalyzed, the said network element. 

monitor system 1662 may wait (1810) a specified time 8. The method of claim 1 wherein said control informa- 

interval before repeating the service level agreement analy- 15 tion is retrieved from said data store using a directory access 

sis procedure using newly updated service level parameter protocol (DAP). 

data reported from the virtual circuit elements. 9. The method of claim 1 further including registering 

If, however, it is determined that the service level quality said network element with an event notification service in 

of the virtual circuit is not to be re -analyzed, the ADMIN order to receive notification of events relating to control 

system 1660 is then notified (1814) of the inability of the 20 parameters associated with said network element, 

virtual circuit to conform with the criteria or guidelines 10. The method of claim 9 further including reporting 

specified by the Service Level Agreement. The ADMIN errors detected by said network element to an event notifi- 

system 1660 may, in turn, report (1816) the SLA problem to cation server. 

a system administrator (via console 1666). Once alerted to 11. The method of claim 10 further including notifying at 

the problem, the system administrator may manually recon- 25 least one other network element of said error reported by 

figure various network elements in order to rectify the said first network element. 

problem. Additionally, the ADMIN system 1660 may also 12. The method of claim 9 wherein said event notification 

report (1816) the SLA problem to the client (e.g., user 1602, service is implemented using a common object request 

user 1620) so that client may take appropriate action, if broker architecture (CORBA). 

desired. 3Q 13. The method of claim 1 wherein said operating param- 
Even after the SLA problem has been reported via eter information is selected from a group consisting of: 
ADMIN system 1660 to the system administrator and/or committed information rate data, committed burst size data, 
client, the monitor system 1662 may continue to perform excess information rate data, circuit queue length data, 
SLA quality analysis of the selected virtual circuit by congestion indicator data, and packets dropped data, 
repeating the service level agreement analysis procedure, as 14 A me thod for providing dynamic feedback control of 
described in FIG. 18. network elements in a data network, the data network 
Although , several preferred ^embodiments of; mis invention includiDg at least one network elemenl) network de- 
have been described m detail herein with reference to the men( hayin ft lura]it operating parameters associated 
accompanying drawings, it is to be understood that the ^ operation parameters beine related to at least 
invention * not limited tc .these precise embodiment and at , J ™ Jd j sa id method com- 
various changes and modifications may be effected therein 40 . . ^ ' 
by one skilled in the art without departing from the scope of prising. 

spirit of the invention as defined in the appended claims. providing operating parameter information relating to at 

What is claimed is: l east one network element to a data store; 

1. A method for providing dynamic configuration of receiving control data, said control data relating to 
network elements in a data network, the data network 45 updated information generated in response to changing 
including at least one network element, said network ele- network conditions, the control data being for affecting 
ment having a plurality operating parameters associated operation of the network element; and 

therewith, said operating parameters being related to at least automatically configuring said network element using 

one control parameter of said element, said method com- said control data to thereby affect operation of said 

Pris^g: .50 network element. 

reporting operating parameter information related to at 15. A computer program product comprising a computer 

least one network element to a data store; readable medium having computer code embodied therein 

receiving an event notification, said event notification for implementing the method of claim 14. 

relating to available updated information for at least 16. The method of claim 14 further including requesting 

one control parameter associated with said network 55 said control data in response to notification of an event 

element; relating to an update of said control data, 

said updated information being generated in response to 17. The method of claim 14 wherein said receiving 

changes in net- work conditions; and includes accessing said control data in response to notifica- 

dynamically configuring said network element using said uon °f an CVCIlt relating to an update of said control data, 

updated information to thereby affect operation of said 60 18. Adynamically configurable data network comprising: 

network element. at least one network element, said network element hav- 

2. The me thod of claim 1 further comprising retrieving, in ing a plurality operating parameters associated 
response to said event notification, the at least a portion of therewith, said operating parameters being related to at 
the updated information at the network element. least one control parameter of said element; 

3. A computer program product comprising a computer 65 said element being operable to report information related 
readable medium having computer code embodied therein to at least a portion of said operating parameters to a 
for implementing the method of claim 1. data store; 
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said element further being operable to retrieve updated 
information relating to at least one control parameter in 
response to receiving an event notification relating to 
available updated information generated in response to 
changes in network conditions; and 5 

said element further being operable to automatically con- 
figure itself using the retrieved updated information to 
thereby affect at least one of said operating parameters. 

19. The network of claim 18 wherein said element is 
further operable to retrieve said updated information from 10 
said data store. 

20. The network of claim 18 wherein said element further 
includes an event notification entity configured to register 
said network element with an event notification service, and 

to receive notification of a registered event. 15 

21. The network element of claim 18 wherein said ele- 
ment further includes a data structure for storing said 
retrieved updated information. 

22. The network of claim 18 wherein said network 
element is a router. 20 

23. The network of claim 18 wherein said network 
element is a data terminating equipment device. 

24. The network of claim 18 wherein said network 
element is a data communication equipment device. 

25. The network of claim 18 wherein said network 25 
element is a switching circuit. 

26. The network of claim 18 wherein said network is a 
frame relay network. 

27. The network of claim 18 wherein said network is an 
ATM network. 30 

28. A dynamically configurable network element in a 
feedback-based adaptive network, said element comprising: 
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at least one CPU; 
memory; 

a data structure for storing control parameter information 
used for configuring said network element; and 

an event handling entity operable to receive event noti- 
fication information relating to updated information 
generated in response to changing network conditions; 

said event handling entity being further operable to cause 
said network element to automatically configure itself 
using the updated information to thereby affect its 
operation. 

29. A system for providing dynamic configuration of 
network elements in a data network, the data network 
including at least one network element, said network ele- 
ment having a plurality operating parameters associated 
therewith, said coe rating parameters being related to at leas 
one control parameter of said element, said system com- 
prising: 

means for reporting operating parameter information 
related to at least one network element to a data store; 

means for receiving an event notification, said event 
notification relating to available updated information 
for at least one control parameter associated with said 
network element; 

said updated information being generated in response to 
changes in network conditions; and 

means for dynamically configuring said network element 
using said updated information to thereby affect opera- 
tion of said network element 
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